Video-based versus written situational judgment tests: a comparison in terms of predictive validity.
نویسندگان
چکیده
In this study, the authors examined whether video-based situational judgment tests (SJTs) have higher predictive validity than written SJTs (keeping verbal content constant). The samples consisted of 1,159 students who completed a video-based version of an SJT and 1,750 students who completed the same SJT in a written format. The study was conducted in a high stakes testing context. The video-based version of an interpersonally oriented SJT had a lower correlation with cognitive ability than did the written version. It also had higher predictive and incremental validity for predicting interpersonally oriented criteria than did the written version. In this high stakes context, applicants also reacted relatively favorably to the SJTs, although there was no significant difference in face validity between the formats. These findings suggest that SJT format changes be made with caution and that validation evidence is needed when changes are proposed.
منابع مشابه
Situational Tests in Student Selection: An Examination of Predictive Validity, Adverse Impact, and Construct Validity
The Flemish Admission Exam `Medical and Dental Studies' is comprised of four cognitive ability tests and four situational tests, namely two work samples (i.e., a lecture and a medical text) and two video-based situational judgement tests (i.e., a physician±patient interaction and a medical expert discussion). On the basis of the Admission Exam scores of 941 candidates (359 men, 582 women) this ...
متن کاملThe Predictive Validity of a Text-Based Situational Judgment Test in Undergraduate Medical and Dental School Admissions.
PROBLEM Situational judgment tests (SJTs) can be used to assess the nonacademic attributes necessary for medical and dental trainees to become successful practitioners. Evidence for SJTs' predictive validity, however, relates predominantly to selection in postgraduate settings or using video-based SJTs at the undergraduate level; it may not be directly transferable to text-based SJTs in undergr...
متن کاملPersonality, Biodata, and Situational Judgment Tests: A Summary of the Research Literature Comparing Predictive vs. Concurrent Validity
متن کامل
Predictive validity of and annual written exams and written tests for assistant's promotion of Mashhad University of Medical Science
ABSTRACT BACKGROUND AND OBJECTIVE: The residency or specialization course in post-graduate medical education in Iran includes 3-5 years depends on different specialization. To be promoted to a higher year, assistants must earn the minimum score specified for their interdepartmental exams and annual national examinations. The aim of this study was to evaluate the predictive validity of these exa...
متن کاملThe validity of interpersonal skills assessment via situational judgment tests for predicting academic success and job performance.
This study provides conceptual and empirical arguments why an assessment of applicants' procedural knowledge about interpersonal behavior via a video-based situational judgment test might be valid for academic and postacademic success criteria. Four cohorts of medical students (N = 723) were followed from admission to employment. Procedural knowledge about interpersonal behavior at the time of ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- The Journal of applied psychology
دوره 91 5 شماره
صفحات -
تاریخ انتشار 2006